My name is Ryosuke Unno. I participated in the LINE internship program in the summer of 2021. As a university student, I study the application of reinforcement learning in video games. During this internship I joined Data Engineering Team 3 of the Data Platform Department. In this article, I'll introduce the activities I was engaged in during this internship period.
Background and issues
Currently, the Data Platform Department operates large-scale Hadoop clusters which offer over 300PB of disk c
